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Abstract 

This paper consists of three parts. The first part presents a large class of new binary quasi-cyclic 
(QC)-LDPC codes with girth of at least 6 whose parity-check matrices are constructed based on cyclic 
subgroups of finite fields. Experimental results show that the codes constructed perform well over 
the binary-input AWGN channel with iterative decoding using the sum-product algorithm (SPA). The 
second part analyzes the ranks of the parity-check matrices of codes constructed based on finite fields 
with characteristic of 2 and gives combinatorial expressions for these ranks. The third part identifies a 
subclass of constructed QC-LDPC codes that have large minimum distances. Decoding of codes in this 
subclass with the SPA converges very fast. 

I. Introduction 

The rapid dominance of LDPC codes [1] in applications requiring error control coding is 
due to their capacity-approaching performance. LDPC codes were first discovered by Gallager 

This research was supported by NSF under the Grant CCF-0727478 and NASA under the Grant NNX09AI21G and gift grants 
from Northrop Grumman Space Technology, Intel and Denali Software Inc. 



April 9, 2010 



DRAFT 



2 



in 1962 [1] and then rediscovered in late 1990's [2], [3]. Ever since their rediscovery, a great 
deal of research effort has been expended in design, construction, structural analysis, encoding, 
decoding, performance analysis, generalizations and applications of LDPC codes. Many LDPC 
codes have been adopted as the standard codes for various next generations of communication 
systems. 

A regular binary LDPC code [1] is given by the null space of a sparse parity-check matrix H 
over GF(2) with constant column weight 7 and constant row weight p. Such an LDPC code is 
said to be (7, p)-regular. If the columns and/or rows of H have multiple weights, then the null 
space of H gives an irregular LDPC code. If H is an array of sparse circulants of the same size 
over GF(2), then the null space of H gives a binary quasi-cyclic (QC)-LDPC codes. 

In almost all of the proposed constructions of LDPC codes, the following constraint on the 
rows and columns of the parity-check matrix H is imposed: no two rows (or two columns) can 
have more than one place where they both have 1 -components. This constraint on the rows and 
columns of H is referred to as the row-column (RC)-constraint. The RC-constraint ensures that 
the Tanner graph [4] of the LDPC code given by the null space of H has a girth of at least 

6 [5], [6]. It also ensures that the minimum distance of a (7, p)-regular LDPC code is at least 

7 + 1. This distance bound is tight for regular LDPC codes whose parity-check matrices have 
large column weights, such as finite geometry cyclic LDPC codes [5] and finite field QC-LDPC 
codes constructed in [7]-[9] and this paper. A parity-check matrix that satisfies the RC-constraint 
is called an RC-constrained parity-check matrix. 

This paper is concerned with construction of algebraic QC-LDPC codes. QC-LDPC codes 
can be efficiently encoded using simple shift-registers [10]. Furthermore, for hardware decoder 
implementation, their QC-structure simplifies wire routing [11] and allows partially parallel 
decoding [12] which offers a trade-off between decoding complexity and decoding speed. Well 
designed algebraic QC-LDPC codes can perform close to the Shannon limit and just as well as 
or even better than their corresponding random or pseudo-random QC-LDPC codes constructed 
using computer-based methods over the binary-input AWGN and binary erasure channel (BEC), 
as demonstrated in [7]-[9]. In [7], a general and three specific methods for constructing algebraic 
QC-LDPC codes based on finite fields were presented. 

In this paper, we present a new class of RC-constrained matrices constructed based on cyclic 
subgroups of finite fields. Based on this class of RC-constrained matrices, a large class of RC- 
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constrained QC-LDPC codes is constructed using the general method presented in [7]. Also in 
this paper, we analyze the ranks of the parity-check matrices of the codes in several subclasses 
of the new codes. Furthermore, we identify a subclass of RC-constrained QC-LDPC codes that 
have large minimum distances. 

The rest of this paper is organized as follows. In Section II, we give a brief review of the 
general method for constructing algebraic QC-LDPC codes presented in [7]. In Section III, we 
first present a large class of new RC-constrained matrices and then give a new class of algebraic 
RC-constrained QC-LDPC codes. The construction of this new class of RC-constrained QC- 
LDPC codes is based on cyclic subgroups of finite fields. We show that this new class of 
QC-LDPC codes contains the major class of QC-LDPC codes constructed in [7] (method- 1) as 
a subclass. We also show that this new class of codes is a large expansion of the QC-LDPC codes 
constructed by the third method given in [8]. In Section IV, we analyze the ranks of the parity- 
check matrices of codes in several subclasses of the new codes. In Section V, we characterize 
a special subclass of new RC-constrained QC-LDPC codes that have large minimum distances 
and are effective for a reliability -based iterative decoding algorithm for a trade-off between error 
performance and decoding complexity. Section VI concludes the paper with some remarks. 

The construction of RC-constrained QC-LDPC codes based on cyclic subgroups of finite fields 
presented in this paper is a counter part of the construction of RC-constrained QC-LDPC codes 
based on additive subgroups of finite fields presented in [9]. In [9], no rank analysis of the 
parity-check matrices of codes is provided. 

II. A General Algebraic Construction of QC-LDPC Codes 

Consider the Galois field GF(g) where g is a power of a prime. Let a be a primitive element 
of GF(g). Then, the powers of a, = 0, a° = 1, a, o?^ . . . , ofl"'^, give all the q elements of 
GF(g) and a^^^ = 1. The q — 1 nonzero elements of GF(g) form the multiplicative group of 
GF(g) under the multiplicative operation defined on GF(g). 

Let P be a (g — 1) X (g — 1) circulant permutation matrix (CPM) whose top row is given by the 
{q — 1) -tuple (0 1 ... 0) over GF(2) where the components are labeled from to g — 2 and the 
single 1-component is located at the position labeled by "1". Then P consists of the (g— l)-tuple 
(0 1 ... 0) and its g — 2 right cyclic-shifts as rows. For 1 < ? < g, let P* be the product of P with 
itself i times, called the ith power of P. Then, P* is also a (g — 1) x (g — 1) CPM whose top row 
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has a single 1 -component at the ith position. For i = q — 1, P'^ ^ = the {q — I) x {q — 1) 
identity matrix. Let P° = P^-^ = Then the set ^ = {P°, P, P^, . . . , P''-^} of CPMs 
forms a cyclic group of order q — 1 under matrix multiplication over GF(2) with p^-i-* as the 
multiplicative inverse of P* and P° as the identity element. 

For the nonzero element a* in GF(g) with 0<z<g — l,we represent it by the (g — 1) x (g — 1) 
CPM P* in This matrix representation is referred to as the (g — l)-fold binary matrix 
dispersion (or simply binary matrix dispersion) of a*. It is clear that the binary matrix dispersions 
of two different nonzero elements in GF(g) are different. Since there are exactly q—l different 
(g — 1) X (g — 1) CPMs in there is a one-to-one correspondence between a nonzero element 
of GF(g) and a (g — 1) x (g — 1) CPM in Therefore, each nonzero element of GF(g) is 
uniquely represented by a (g — 1) x (g — 1) CPM in For a nonzero element 5 in GF(g), we 
use the notation B(5) to denote its binary matrix dispersion. If 5 = a\ then B(5) = P*. For the 
0-element of GF(g), its binary matrix dispersion is defined as the (g — 1) x (g — 1) zero matrix 
(ZM), denoted by P-~. 

Consider a k x n matrix over GF(g), 



W = 



Wo 




Wofi 


W0,1 


■ Wo,n-l 


Wi 








■ Wi,n-1 













whose rows satisfy the following constraint: for < i,j < k,i j and < c, / < g — 1, the 
Hamming distance between the two g-ary n-tuples, a'^Wj and a'wj, is at least n — 1, (i.e., a^Wi 
and a'-Wj differ in at least n — 1 places). The above constraint on the rows of matrix W is called 
the row-distance (RD)-constraint and W is called an RD-constrained matrix. 

For < i < k and < j < n, dispersing each nonzero entry Wij of W into a (g — 1) x (g — 1) 
CPM Bij = B( Wij) over GF(2) and each 0-entry into a (g — 1) x (g — 1) ZM, we obtain the 
following k X n array (or block) of CPMs and/or ZMs over GF(2) of size (g — 1) x (g — 1): 

^ ~ [^hj]o<i<k,0<j<n ■ 

H is called the binary (g — l)-fold array dispersion of W (or simply binary array dispersion of 
W) and it is a k(q — 1) x n(q — 1) matrix over GF(2). Based on the RD-constraint on the rows 
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of W and the binary CPM matrix dispersions of the entries of W, it was proved in [7], [8] that 
H, as a k{q — 1) x n{q — 1) matrix over GF(2), satisfies the RC-constraint. 

The null space of H gives a binary RC-constrained QC-LDPC code Cgc of length n{q — 1) 
whose Tanner graph has a girth of at least 6. The subscript "gc" of Cgc stands for "quasi-cyclic". 
If H has constant column and row weights, then Cgc is a regular QC-LDPC code; otherwise, 
it is an irregular QC-LDPC code. Since H is an array of CPMs and ZMs, it is referred to as 
a circulant-based parity-check matrix (CPCM). Any RC-constrained CPCM gives a QC-LDPC 
code with girth at least 6. In [7]-[9] several classes of RD-constrained matrices over finite fields 
were given. By array dispersions of these classes of RD-constrained matrices, several classes 
of RC-constrained QC-LDPC codes were constructed. The codes given in the examples of [7]- 
[9] decoded with iterative decoding using the sum-product algorithm (SPA) displayed excellent 
performance in terms of error-rate, error-floor and rate of decoding convergence. 

III. A Class of RC-Constrained QC-LDPC Codes on Finite Fields 

In this section, we first present a large and very flexible class of RD-constrained matrices 
constructed based on cyclic subgroups of finite fields. Then, based on this class of RD-constrained 
matrices, we construct a class of RC-constrained QC-LDPC codes. 



A. A Class of RD-Constrained Matrices 

Let a be a primitive element of GF(g). Suppose that q — I can be factored as a product of 
two integers, c and n, that are relatively prime. Then q — \ = on. Let (3 = a'^ and 5 = a". Then 
the orders of (3 and 5 are n and c, respectively. The set = = 1, /3, . . . , and the 

set = {<^° = 1, • • • 5 5^^'^} form two cyclic subgroups of the multiplicative group of GF(g). 
Since c and n are relatively prime, 5fi and ^2 can only have the unit element "1" in common. 

For < j < c, form the following nxn matrix over GF(g) using a single element from ^2 
and all the elements in 



w 



n-1 



(3) 
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From the structure of Wj ^ displayed by ([3]), we can readily see or prove that Wj ^ has the 
following structural properties: 1) each row is the right cyclic-shift of the row above it multiplied 
by (3 and the first row is the right cyclic-shift of the last row multiplied by (3; 2) each column is 
the downward cyclic-shift of the column on its left multiplied by (3 and the first column is the 
downward cyclic-shift of the last column multiplied (3; 3) all the entries in a row (or a column) 
are distinct elements of GF(g); 4) any two rows (or columns) differ in every position; 5) for 
i j, all the entries in Wjj are nonzero elements of GF(g); and 6) for i = j, the entries on the 
main diagonal of Wj j are zeros and all the other entries are nonzero. 

Theorem 1: For < i, j < c, the n x n matrix given by ([3]) Wj j satisfies the RD-constraint. 
Proof: Let and w/ be two different rows in Wj j. Then, k ^ I. For any two integers e 
and / with 0<e,/<g — 1, consider the two n-tuples over GF(g), a^w^ and a^wi. It follows 
from the structural properties 4 to 6 of Wj ., that a^Wj and a^wj cannot have any position 
where they both have 0-components. Next, we prove that a'^w^ and a^wi cannot have more 
than one position where they have identical nonzero components. Suppose that a^w^ and a^wi 
have identical nonzero components at two different positions s and t (s ^ t) . Then, we have the 
following equalities: - 13') = af{5^-'(3^ - 13') and a\5^-'(3^ - /?*) = - /?*). 

From these two equalities, we obtain the equality — (3'){(3^ — 13'^) = 0. This equality holds 
if and only if either k = I or s = t which contradicts the facts that neither k ^ I nor s ^ t. 
Therefore, a^Wk and a-^w^ can not have more than one position where they have identical nonzero 
components. It follows from the above proven facts that Wjj satisfies the RD-constraint. ■ 

It follows from Theorem 1 that Q = {Wjj '■ < i, j < c} gives a set of RD-constrained 
matrices over GF(g). Each matrix in can be used as a base matrix for array dispersion to 
construct QC-LDPC codes. In the following, we show that the RD-constrained matrices in Q 
can be used to form a much larger RD-constrained matrix for array dispersion to construct 
QC-LDPC codes. 

Form the following c x c array with Wjj, < i,j < c, as sub-matrices: 



Wo,o 



Wo,i 



Wo,c-i 



W 



1,0 



W 



w 



1,1 



w 



(4) 



W, 



c-1,0 



W, 



w, 



c-l,c-l 
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W is a c X c array of n x n sub-matrices. Since cn = g — 1, W is a (g — 1) x (g — 1) matrix 
over GF(g). For < i, j < c, it follows from the composition of the entries of WjjS displayed 
in ([3]), we readily see that Wj+i j+i = Wj j with i + 1 and j + 1 reduced by modulo-c. Then, 
every row of submatrices of W is a right cyclic-shift of the row above it and the first row is 
the right cyclic- shift of the last row. 

For < i < c,0 < k < n, every integer in {0, 1, 2, . . . , cn — 1 = g — 2} can be expressed as 
in + k. Let Win+k denote the (in + A;)th row of W, as a (g — 1) x (g — 1) matrix. Then 

Wj„+fc = (Wj_o,fc, Wj^i^fc, • • • , Wj_c-l,fc), (5) 

which consists of c sections, n components each. For < j < c, the jth section w^j ^ = 
(^i-i/jfc - f3^, 5^-' (3^ - f3\..., 5^^' (3^ - of Wi^+k is simply the A;th row of the submatrix 

Wj J of W. From dS]) and properties 5 and 6 of each submatrix Wj ^ of W, we readily see that 
^in+k contains one and only one 0-component at the {in + A;)th position (or the A;th position of 
ith section Wj j fc). Therefore, W contains g — 1 0-entries that lie on the main diagonal of W, 
as a (g — 1) X (g — 1) matrix over GF(g). It follows from property 4 of each submatrix Wj j 
that any two rows of W differ in every position. 

Theorem 2: The (g — 1) x (g — 1) matrix W given by dH) satisfies the RD-constraint. 
Proof: Let < zi, Z2 < c, < A;i, A;2 < 't-, and iin + ki ^ Z2n + /c2. In this case, either i\ ^ Z2 
or kx 7^ k'l- Then ^i^n+kx and Wjj^+fcj are two different rows of W. It follows from structural 
property 4 of the RD-constrained submatrices Wj jS that Wjj„+fc^ and ^^^n-^k^ differ in every 
position and cannot have any position where they both have 0-components. For < e, / < g — 1, 
consider the two g-ary (g — l)-tuples, a^vi^im+fei and a^^i^n+k^- Suppose there are two different 
positions, jin + s and + t with < ji, j2 < c, < s, t < n (i.e., j\n + 57^ + t), where 
a'^Wi-^n+kx and a^V'fi^n^k^ have identical nonzero components. Based on this hypothesis, we have 
following two equalities: a\b^^-'^(i^^ - = {b^^-'^'' p>^^ - and a^b^-"-'^^^^ - /?*) = 
Q,/(^^i2-«2^fc2 _ ^ty pj-om these two equalities with some algebraic manipulations, we obtain the 
following equality: (5-'2-Ji = f^-^^ . Since /3 and b are elements in the cyclic subgroups Sfi and 
^2> respectively, and ^1 = the equality b'j'^^j^ = (3*^^ holds if and only if j2 = ji and 
t = s simultaneously. These two equalities imply that jin + s = j2n + 1 which contradicts our 
assumption that jin + s ^ j2n + 1. Consequently, a'^Wi^^n+ki and a-^Wij^+fc^ can have at most 
one position where they have identical nonzero components. It follows from the above proven 
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facts that a^vfi-^n+ki and a^Wi^n+k2 differ in at least cn — 1 = g — 2 places. Hence, W satisfies 
the RD-constraint. ■ 

Consider the special case for which c = 1 and n = g — 1. In this case, (3 = a, 5 = 1 and 

1-1 I- a ■■■ 1 - a"-^ 



W 



a — 1 



a — a 



q-2 



a — a 



^9-2 _ ^^"-2 



(6) 



a''"^ - 1 - a 

From @ we see that every row (column) of W is the right (downward) cyclic-shift of the row 
(column) above it (on its left) multiplied by a and the first row is the right (downward) cyclic- 
shift of the last row (column) multiplied by a. All the g — 1 entries in a row (or a column) of 
W are distinct elements in GF(g). Each row (column) contains a 0-element. Therefore, in each 
row (or column), there is a nonzero element in GF(g) that is not included. 

For the special case with c = q — 1 and n = 1, we have the following RD-constrained matrix 
over GF(g): 



W 



a" - 1 



a 



a 



q-2 



a 



q-2 



1 



a 



<?-3 _ ]^ 



(7) 



a — 1 o? — \ ■ ■ ■ — 1 
From (7), we see that every row of W is the right cyclic-shift of the row above and the first row 
is the right cyclic-shift of the last row. This matrix is exactly the same as the RD-constrained 
matrix given by Eq. (4) of [7] (with rows permuted) which was used as the base matrix for the 
major construction of QC-LDPC codes in [7]. Therefore, the construction of RD-constrained 
matrices presented in this paper is an expansion of the construction of the RD-constrained 
matrices (method 1) given in [7]. 

If we take the first columns from the submatrices, Wq^o; Wo,i, . . . , Wo,c-i, of W given by 
(4), then we obtain the following n x c submatrix of W: 
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w* 







S-1 



5^-2 - 1 

(5^-^/3 - 1 



(8) 



- 1 5/3"-! - 1 ■ ■ ■ - 1 

W* is exactly in the same form as that of the RD-constrained matrix W'^'^^ given by Eq. (6) 
in [8], except for the notations and that there is an extra column, [—1, —1, . . . , —1]^ , in W^'^\ 
Therefore, the RD-constrained matrix W given by (4) is an expansion of the RD-constrained 
matrix W'^'^^ given by Eq. (6) in [8]. 



B. A Class of QC-LDPC Codes on Finite Fields 

By array dispersion of W given by ©, we obtain the following c x c array ofnxn subarrays 
of (q' — 1) X (g — 1) CPMs and zero matrices over GF(2): 



For < z, j < c, 





H = 


■^«j]o<i<c.O<j<c 








-'-'0,1 


■'-'0,n-l 




■■-•1,0 


-r{«j) 
■'-'1,1 


■r{«j) 
■'-'l,n-l 




B(iJ) 


■'-'n-1,1 


■'-'n-l,n- 



(9) 



(10) 



is the array dispersion of the RD-constrained matrix Wj j, where B^*'/-* = B(5'' ^(3^ — is the 
matrix dispersion of the entry 6^~^f3^ — (3^ at the k\h row and /th column of Wjj. b[,''/^ is a 
(g - 1) X (g - 1) CPM if 5^-^(3'' - /3V and a (g - 1) x (g - 1) ZM if - = 0. From 

dH) and ([lOl), we see that H is a (g - 1) x (g - 1) array of (g - 1) x (g - 1) CPMs and ZMs. 
Each row (or column) block of H consists of g — 2 CPMs and one ZM. Therefore, H contains 
g — 1 ZMs which lie on the main diagonal of H. H is a (g — 1)^ x (g — 1)^ matrix over GF(2) 
with both column and row weights g — 2. Since W satisfies the RD-constraint, H satisfies the 
RC-constraint and can be used to construct RC-constrained QC-LDPC codes. 

For any pair (7, p) of integers 7 and p with 1 < 7, p < g , let H(7, p) be a 7 x p subarray 
of H, as a (g — 1) X (g — 1) array of CPMs and ZMs. H(7, p) is a 7(g — 1) x p(g — 1) matrix 
over GF(2) which also satisfies the RC-constraint. The null space of H(7, p) gives a binary 
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QC-LDPC code Cgc of length p{q — 1) with rate at least (p — j)/p, whose Tanner graph has 
a girth of at least 6. For a given finite field GF(g), the above construction gives a family of 
structurally compatible binary QC-LDPC codes. 

If H(7,p) does not contain any ZM of H, H(7,p), as a 7(g — 1) x p(q — 1) matrix over 
GF(2), has constant column weight 7 and constant row weight p. Then Cgc is a (7, p)-regular 
QC-LDPC code with minimum distance at least 7 + L Note that the sum of the q — I rows 
of a CPM gives an all-one (q — l)-tuple over GF(2). If we add all the q — I rows of a row 
block of CPMs of H(7, p), we obtain an all-one row vector u = (1 1 ... 1) of length p{q — 1) 
which is a codeword in the code spanned by the rows of H(7, p) which is the dual code of 
Cgc- Then the inner product each codeword of Cgc and the all-one vector u must be zero. This 
implies that every codeword in Cgc has even weight and hence the minimum weight of Cgc must 
be even. For even 7, 7 + 1 is odd. Then the minimum distance of Cgc must be at least 7 + 2. 
For odd 7, 7 + 1 is even. In this case, 7 + 1 gives a lower bound on the minimum distance of 
Cgc- If H(7, p) contains ZMs in some of its columns but not in all its columns, then H(7, p), as 
a 7(g — 1) X p(q — 1) matrix, has two different column weights, 7 — 1 and 7. In this case, the 
RC-constraint ensures the minimum distance of the QC-LDPC code Cgc given by the null space 
of H(7, p) is at least 7. 

In the following, we use two examples to illustrate the above construction of QC-LDPC 
codes. For each code constructed, we compute its error performance over the AWGN channel 
with BPSK signaling decoded using the SPA [3], [6], [13] with no more than 50 iterations. 

Example 1: Let GF(2'^) be the field for code construction. Suppose we factor 2"^ — 1 = 15 
as the product of 3 and 5. Set c = 3 and n = 5. Let a be a primitive element of GF(2'^). Set 
13 = and 5 = a^. Then the orders of (3 and 5 are 5 and 3, respectively. Form two cyclic 
subgroups of the multiplicative group of GF(2^) as follows: ^1 = = 1, /3, Z?"^, and 
^2 = {S^ = 1, S"^}- Based on ([3]) and ([4]), we construct a 3 x 3 array W of 5 x 5 submatrices 
over GF(2^). W is a 15 x 15 RD-constrained matrix over GF(2''). Dispersing each nonzero 
entry of W into a binary 15 x 15 CPM and each zero entry into a 15 x 15 ZM, we obtain a 
15 X 15 array H of CPMs and ZMs of size 15 x 15. For any pair of positive integers, (7, p), 
with 1 < 7, p < 15, the null space of a 7 x p subarray H(7, p) of H gives a binary QC-LDPC 
code of length 15p. Suppose we choose 7 = p = 15. In this case, we use the entire array H as 
the parity-check matrix. It is a 225 x 225 matrix over GF(2) with both column and row weights 
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14. The null space of H gives a (225, 147) QC-LDPC code with rate 0.653. Since the column 
weight is 14, the minimum distance is at least 15. The error performances of this code over 
the binary-input AWGN channel decoded using the SPA with 5, 10 and 50 iterations are shown 
in Figure 1. We see that the decoding of this code converges very fast. At the block error rate 
(BLER) of 10^^, the code performs 0.9 dB from the sphere packing bound. AA 
Example 2: Let GF(379) be the code construction field. Suppose we factor 379 — 1 = 378 
as the product 6 and 63. Set c = 6 and n = 63. Let a be a primitive element of GF(379). 
Set /3 = and 6 = a^^. Then the orders of (3 and 6 are 63 and 6, respectively. Form two 
cyclic subgroups of GF(379): = {a° = 1, a, . . . , a^^} and % = {S'^ = 1, S, . . . , S^}. Based 
on these two subgroups, (3), (4), (9) and (10), we can construct a 378 x 378 array H of CPMs 
and ZMs of size 378 x 378. Take a 4 x 32 subarray H(4, 32) from H, avoiding ZMs. H(4, 32) 
is a 1512 X 12096 matrix over GF(2) with column and row weights 4 and 32, respectively. The 
null space of this matrix gives a binary (4, 32)-regular (12096, 10587) QC-LDPC code with rate 
0.8752. The error performance of this code over the binary-input AWGN channel decoded using 
the SPA with 10 and 50 iterations are shown in Figure 2. At the BER of 10^^, the code performs 
only 1 dB from the Shannon limit. We also see that decoding of this code converges fast. At a 
BER of 10^^, the gap between 10 and 50 iterations in performance is only 0.2 dB. AA 

C. Masking 

A set of binary CPMs in a chosen 7 x p subarray H(7, p) = [B^ of the array H given 
by (9) can be replaced by zero matrices. This replacement is referred to as masking [6], [7], 
[14], [15]. Masking results in a sparser matrix whose associated Tanner graph has fewer edges 
and hence fewer short cycles and probably a larger girth than that of the associated Tanner 
graph of the original 7 x p subarray H(7,p). To carry out masking, we first design a low 
density 7 x p matrix Z(7, p) = [zk,i] over GF(2). Then we take the following matrix product: 
M(7,p) = Z(7,p) (g)H(7,p) = [zk^iBk^i], where Zk^iBkj = B^,; for Zk^i = 1 and Zk,iBk^i = 
(a (g — 1) X (g — 1) zero matrix) for z^^i = 0. We call Z(7,p) the masking matrix, H(7,p) the 
base array and M(7,p) the masked array, respectively. Since the base array H(7,p) satisfies 
the RC-constraint, the masked array M(7, p) also satisfies the RC-constraint, regardless of the 
masking matrix. Hence, the associated Tanner graph of the masked matrix M(7,p) has a girth 
at least 6. The null space of the masked array M(7,p) gives a new binary QC-LDPC code [6], 
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[7], [15]. Masking can be either regular or irregular. Masking subarrays of H produces many 
more QC-LDPC codes. 

Example 3: In this example, we construct a long irregular code and show how close it performs 
to the Shannon limit over the binary-input AWGN channel with iterative decoding. Let GF(2^) 
be the field for code construction. Suppose we factor 512 — 1 = 511 as the product of 7 x 73. 
Set c = 7 and n = 73. Let a be a primitive element of GF(2^). Set /3 = a'' and S = a'^^. 
Form two cyclic subgroups of the multiplicative group of GF(2^), = . . . and 

% = {<^°, ^, • • • , ^^}- Based on these two groups, (3), (4), (9) and (10), we construct an RC- 
constrained 511 x 511 array H of CPMs and ZMs of size 511 x 511 with the ZMs lying on the 
main diagonal of the array. Choose 7 = 63 and p = 126. Take a 63 x 126 subarray H(63, 126) 
from the array H, avoiding zero matrices. We will use this subarray as a base array for masking 
to construct an irregular code of rate 0.5. 

Consider the following degree distributions of variable nodes and check nodes of a Tanner 
graph optimally designed for an irregular code with rate 1/2 and infinite length: A(X) = 
0.4410X + 0.3603X2 ^ 0.00171X5 + 0.03543X6 + 0.09331X^ + 0.0204XS + 0.0048X9 + 
0.04305X^9, and p(X) = 0.00842X^ + 0.99023X8 + 0.00135X9, where the coefficient of X* 
represents the percentage of nodes with degree i + 1. Next, we construct a 63 x 126 matrix 
Z(63, 126) matrix over GF(2) with column and row weight distributions based on the above 
degree distributions. By computer search, we construct such a matrix with column and row 
weight distributions given in Table 1. Masking the 63 x 126 subarray H(63, 126) with Z(63, 126), 
we obtain a 63 x 126 masked array M(63, 126) = Z(63, 126) (g) H(63, 126) of 511 x 511 CPMs 
and ZMs of size 511 x 511. It is a 32193 x 64386 matrix over GF(2) with column and row 
weight distributions close to the optimal degree distributions of the variable and check nodes 
of the Tanner graph for an irregular LDPC code of rate 0.5 given above. The null space of 
M(63, 126) gives an irregular binary (64386, 32193) QC-LDPC code. The error performance of 
this code with 50 iterations of the SPA is shown in Figure 3. We see that at the BER of 10"^, the 
code performs 0.55 dB from the Shannon limit. Also included in Figure 3 is the performance of 
a (64386, 32193) pseudo-random irregular QC-LDPC code constructed with the PEG-algorithm 
[16] based on the same node degree distributions, A(X) and p(X), given above. We see that the 
algebraic code slightly outperforms its corresponding pseudo-random code. AA 
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IV. Rank Analysis 

In this section, we analyze the ranks of the parity-check matrices of a subclass of QC-LDPC 
codes constructed in Section III with q = 2™, i.e., codes constructed based on GF(2'"). 

Definition 1: Let A = [a^j] and B = [bij] be two kx n matrices over GF(g). The Hadamard 
product of A and B is defined as their element-wise product A o B = [ajj&ij] [17]. 

It is clear from the definition that Hadamard product A o B of A and B is also a kxn matrix 
over GF(g). If B = A, then A°^ = A o A = [d^j]- For any positive integer /, let A°' denote the 
Hadamard product of A with itself / times, i.e., A°' = A o A o . . . o A. Then A°' = [a[j]. We 
call A°' the /th-fold Hadamard product of A. For / = 1, A°^ = A and A°'^ = A. 

Let G be a matrix over GF(2'") and M be the binary (2™ — l)-fold array dispersion of G. 
Then M is an array of CPMs and/or ZMs over GF(2) of size (2™ - 1) x (2™ - 1). It has been 
proved in [18] that the rank of M, denoted by ran/c(M), can be expressed in terms of the ranks 
of the Hadamard products of G, G°\ G°^, G°(2'"-i) as given in Theorem 3. 

Theorem 3: Let G be a A; x n matrix over GF(2™) and M be the binary (2™ — l)-fold 
array dispersion of G. Then the rank of the kxn array M of CPMs and/or ZMs of size 
(2™ - 1) X (2™ - 1) over GF(2) is equal to 

2'"-! 

rank{M) = ^ rank{G°^). (11) 
1=1 

For the simplicity of analysis, we consider the RD-constrained matrix W over GF(2'") given 
by dll). Since the characteristic of GF(2'") is 2, the subtraction "-" in ^ can be replaced by 
modulo-2 addition Let =c/ = {0, 1, . . . , 2"^ - 2} be an index set of order 2™ - 1. Label the 
rows and columns of W of (|6l) in the order of 0, 1, . . . , 2™ — 2. Then, 

W=[«^ + «^].,^,,^- (12) 
Then, for any positive integer /, the /th-fold Hadamard product W°' of W is given by 

w°^ = [K+«^y].,^,,^. (13) 

Let H be the array dispersion of the RD-constrained matrix W given in the form of (fT2l) . It 
is (2™ - 1) X (2'" - 1) array of CPMs and ZMs of size (2™ - 1) x (2™ - 1). Corresponding to 
the column and row labeling of W, we label the row and column blocks (CPMs and/or ZMs) 
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of H in the order of 0, 1, . . . , 2"* - 2. For 1 < 7 < 2"^ - 1 and p = 2'" - 1, let H(7, 2"* - 1) be a 
7 X (2"' — 1) subarray of H that consists of 7 row blocks of H. Without loss of generality, we take 
the first 7 row blocks of H to form H(7, 2"^ — 1) for the simplicity of notations and expressions. 
Let W(7,2"' — 1) be the first 7 rows of W. Then 11(7,2™ — 1) is the array dispersion of 
W(7, 2"^ — 1). It follows from Theorem 3 that the rank rank{ii{'j, 2"' — 1)) is given as follows: 

2'"-l 

rank{H{-f, 2"^ - 1)) = ^ rank{W°'{-f, 2™ - 1)). (14) 

1=1 

Theorem 4: For 1 < / < 2"\ let A; be the number of odd integers in the /th row of the Pascal's 
triangle [19]. Then, for 1 < 7 < 2"* — 1, the rank of W°'(7, 2"' — 1) is given as follows: 



rank (W°' (7,2"-!)) 



min (7, A,) , for 1 < / < 2'" - 1, 

min (7, A; - 2) = min (7, 2"* - 2) , for / = 2™ - 1. 

(15) 

Proof: Let be the subset of index set which consists of the first 7 indices of . 
Then, the 7 x (2™ — 1) submatrix W(7, 2™ — 1) of W can be expressed as follows: 

For 1 < / < 2", the /th-fold Hadamard product W°'(7, 2™ - 1) of W(7, 2*" - 1) is given by 

W°'(7,2™-l)=[(a^ + a^y]^^^^^^.^^. 
Binomial expansion of (a* + «■')' results in the following expression: 

(a' + a^y = ^('^')a^('-*)a^*. (16) 

Since the characteristic of GF(2'") is 2, (J) = 1 (modulo-2) if (J) is odd and (J) = (modulo- 
2) if (I) is even. Let ti, ^2, • • • , ^a, be the set of nonnegative integers for which the binomial 
coefficients (^' ), (^'J, . . . , ) are odd. Note that A; is simply the number of odd integers in the 
Pascal's triangle at the /th level and A^ < / + 1. Also note that Qj = Q = 1, thus ti = and 
tx^ = I. Then the binomial expression of (fT6l) is reduced to the following form: 



[a' + = + + d^^-^^'^a^'^ + . . . + d^^''^^-''^ d'^^-^ + d\ (17) 

There are two cases to be considered. First, we consider the case for which 1 < / < 2™ — 
1. Based on the expressions of flT]) and W°'(7,2"' - 1) = {{d + d)^\-^^ the /th-fold 
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Hadamard product W° (7, 2™ — 1) of W(7, 2™ — 1) can be put into the following form: 



W°'(7,2'" - 1) 



0\'-t2 



l\i-t2 



1' fa^-M'"'^ 



1 1 



fa")' (a'Y 



(18) 



■■A, X (2™ -1) 



L7XA, 0^x(2'n-l-A,) 



R 



A,x(2"'-l) 



R-{2'"-l-A,)x(2'"-l) 



The matrix R 
matrix: 



consists of A; rows of the transpose V"^ of the following Vandermonde 



V = 



[a ) 



(19) 



(2'"-l)x{2™-l) 



The matrix R consists of all the other rows of V^. Therefore = [R-^ R-^]^. The matrix 
i_Ai) is a A/ X (2™ — 1 — A;) ZM. Since L^xA; is 7 x A/ submatrix of the Vandermonde 



Oa,x(2" 

matrix V, rank(L^xXi) = min(7, A/). Since the rank of V-^ is 2™ — 1, then it follows from 

(fTSi) that ran/c(W°'(7, 2™ — 1)) = rank{Lyy^Xi) = inin(7, A^). This proves the first part of the 

theorem for the case 1 < / < 2'" — 1. 

Now, we consider the case for / = 2™ — 1. From (fTSi) . we can see that when / = 2"^ — 1, the 



first column of L^xa, becomes an all-1 vector, which is the same as the last column of L^xa,- 
Also we note that the first row of Ra;x(2™-i) is an all-1 vector which is the same the last row 
of Ra,x(2™-i)- For / = 2"^ — 1 and A; = 2"\ we have. 



w 



o{2'"-l) 



(7,2™-l) = 



(a ) 



1 



-1x2"* -2 



qO 1 
a' 1 



1 

,o\i 



-'7x2'^ 



(a ) 



1\ 2™-2 



-'7X(2'"~2) 



>-(2"»-2)x(2'"-l) 



(20) 



April 9, 2010 



DRAFT 



16 



Since R(2'"-2)x(2™-2) is a square submatrix of the Vandermonde matrix V, rafiA;(R(2"i-2)x(2™-2)y 
2" - 2. Then, it follows from (20) that 



ran 



fc(W°(2"-i)(7, 2*" - 1)) = min(7, 2"^ - 2). 



This completes the proof of the theorem. ■ 
A combinational expression for the rank of a 7 x (2™ — 1) subarray H(7, 2™ — 1) of the array 

H given by (6) can be derived. 

Theorem 5: For g = 2"^, 1 < 7 < 2"^ — 1, let be the largest positive integer such that 

2*^ < 7 < 2*^+^ Then 



7 (2™ - 1) - V (7) (7 - 2*), for 1< 7 < 2"^ - 1, 
ranfc(H(7,2'"-l)) = <; ^ t=/*^^ ^ " (21) 

3"* - 3, for 7 = 2™ - 1. 

Proof: It follows from ^ that for 1 < 7 < 2"^ - 1, rank (W°' (7, 2™ - 1)) = min (7, A,), 

2'"-l 

where 1 < / < 2"^ - 1. Then rank (H (7, 2"* - 1)) = E min (7, A;). 

First, we prove the combinatorial expression for the case 1 < 7 < 2™ — 1. Label the Pascal's 
triangle from level-0. For < / < 2™, the Ith level of the Pascal's triangle consists of the 
following binomial coefficients: Q = 1, [[), . . ., (^^J, [\) = 1. An integer / with < / < 
2"* can be expressed in the following radix-2 form: / = oq + ai2 + 022^ + . . . + 0^-12™"^, where 

m— 1 

Oj = or 1 for < i < m. The sum w{l) = ^ Oj is called the radix-2 weight of the integer 
/. It is clear that < w{l) < m. Then A; = 2"'('). We readily see that 7 < A/ if < w{l) and 
Ai < 7 if w{l) < tj. 

Let ^0 = {I5 2, . . . , 2"^ — 1}. Then the sum J2i=i^ min(7, A^) can be put into the following 
form: 

2'"-l 2'"-l 

^ min(7, AO = ^^(^^ 2-«) = E ^ + E ^"'W. 

1=1 1=1 i£.'^o,t~,<w(i) ie.^jgo,w{i)<u, 

The number of integers in ^0 that have radix-2 weight t with < t < m is (^). Then the 
above equality can be put in the following combinatorial form: 



e™m...^eJ:).^i:(T)-.e(:)-e(T)(.-') 
=i<2"-i)-|:(7)(o^-2'). 
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This gives the first part of (21). 

For the case 7 = 2™ — 1, it follows from (14), (15) and A2'"-i 




ranA;(H)=ranfc(H(2™-l,2"^-l))= > A; + 2™ - 2 = > A; - 2 (22) 



It is known that the total number of odd integers in the Pascal's triangle of 2™ levels (labeled 
from to 2™ — 1) is 3™ [19]. Since at the 0th level of the Pascal's triangle, there is a single odd 
integer which is "1", therefore the rank of H(2'" — 1, 2™ — 1) is 3™ — 3. This gives the second 
equality of (21). ■ 

Example 4: Let GF(2^) be the field for code construction. Based on this field, we construct 
a 63 X 63 RD-constrained matrix W over GF(2^) in the form given by (6). Array dispersion of 
W results in a 63 x 63 array H of CPMs and ZMs of size 63 x 63. Choose 7 = 6. Suppose 
we take the first 6 rows of H to form a 6 x 63 subarray H(6,63). H(6,63) is a 378 x 3969 
matrix over GF(2) with constant row weight 32 and two different column weights, 5 and 6. 
To determine the rank of H(6, 63), we apply Theorem 5. First, we find that = 2. Using the 
first combinatorial expression given by (21), we find that ranfc(H(6, 63)) = 324. Hence the 
null space of H(6, 63) gives a (3969, 3645) near-regular QC-LDPC code with rate 0.9183. The 
performance of this code with 50 iterations of the SPA is shown in Figure 4. At the BLER 
of 10^"^, the code performs 0.75 dB from the sphere packing bound. At the BER of 10^^, the 
code performs 1.2 dB from the Shannon limit. For comparison, a corresponding near-regular 
pseudo-random (3969, 3645) QC-LDPC code is constructed with the PEG-algorithm. Its error 
performance is also included in Figure 4. We see that the algebraic (3969, 3645) code outperforms 
its corresponding pseudo-random code. AA 

Example 5: We use GF(2'') for code construction. Based on this field, we construct an RD- 
constrained matrix W over GF(2^) in the form given by (6). Dispersing W, we obtain a 127 x 127 
array H of CPMs and ZMs of size 127 x 127. Choose 7 = 6. Suppose we take the first 6 rows of 
H to form a 6 x 127 subarray H(6, 127). H(6, 127) is a 762 x 16129 matrix over GF(2). Based on 
Theorem 5 and the first expression (21), we find that t^ = 2 and ran/c(H(6, 127)) = 692. Hence 
the null space of H gives a (16129, 15437) QC-LDPC code with rate 0.9571. The performance 
of this code with 50 iterations of the SPA is shown in Figure 5. At the BERs of 10^^ and 10~^, 
the code performs 0.8 dB and 0.95 dB from the Shannon limit, respectively. For comparison, a 
corresponding near-regular pseudo-random (16129, 15437) QC-LDPC code is constructed with 
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the PEG- algorithm. Its error performance is also included in Figure 5. We see that the algebraic 
code slightly outperforms its corresponding pseudo-random code. A A 

V. A Special Subclass of RC-Constrained QC-LDPC Codes 

An RC-constrained (7, p)-regular LDPC code whose parity-check matrix has column weight 
7 is one-step majority-logic decodable and is capable of correcting [7/2J or fewer errors with 
one-step majority-logic decoding (OSMLGD) [5], [6]. OSMLGD is one of the simplest hard- 
decision decoding methods which requires only binary logical operations. For an RC-constrained 
(7, p)-regular LDPC code to be effective with OSMLGD, its parity-check matrix must have a 
reasonably large column weight 7. 

For a given field GF(g), let Cqcj be the QC-LDPC code generated by the null space of the 
full RC-constrained array H obtained by array dispersion of the RD-constrained base matrix W 
given by (4). The subscript "/" of Cqcj stands for "full array". Since the column weight of H 
is g — 2, the code Cqcj is capable of correcting [(g — 2)/2j or fewer errors with the OSMLGD. 
For q = 2"^, it follows from the second expression of (21) (Theorem 5) that the rank of the full 
array H is 3'" — 3. In this case, Cqcj is an RC-constrained QC-LDPC code with the following 
parameters: 1) length (2™ — !)^; 2) number of parity-check symbols 3^ —3; 3) minimum distance 
at least 2'" — 1: and 4) OSMLGD error-correction capability 2™"^ — 1. Since the number of rows 
of H is (2™ - 1)2 and the rank of H is 3"^ - 3, H has (2™ - 1)^ -3^ + 3 redundant (or linearly 
dependent) rows. For m > 3, H has a large row redundancy. 

The code Cqcj given by the full array H, not only performs well with iterative decoding using 
the SPA but also provides good error performance when decoded using the iterative binary 
message-passing decoding algorithm (IBMPDA) presented in [20] with significant reduction in 
decoding complexity. The IBMPDA presented in [20] requires only integer additions and binary 
logical operations. The number of integer additions required per iteration in decoding Cqcj is 
equal to the number of 1-entries in H which is (g — 2)(g — 1)^. It is shown in [20] that this 
IBMPDA outperforms all the known existing weighted bit flipping (WBF) decoding algorithms 
with much less computational complexity and performs close to the SPA. 

Example 6: Consider the 63 x 63 RC-constrained array H of CPMs and ZMs of size 63 x 63 
constructed based on GF(2®) given in Example 4. It is a 3969 x 3969 matrix over GF(2) with both 
column and row weights 62. Using the second expression of (21) given in Theorem 5, we find 
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that the rank of H is 726. The null space of H gives a (3969, 3243) RC-constrained QC-LDPC 
code Cgcj with rate 0.8171 and minimum distance at least 63. The error performance of this 
code over the AWGN channel decoded using the SPA with 5, 10 and 50 iterations is shown 
in Figure 6. We see that the decoding of this code converges very fast. The performance gap 
between 10 and 50 iterations is negligible and the performance gap between 5 and 50 iterations 
is less than 0.2 dB at the BER of 10"^ At the BLER of 10~^ the code performs 1.2 dB from 
the sphere packing bound. Also included in Figure 6 are the performances of the code decoded 
with the IBMPDA presented in [20] and the OSMLGD. We see that at the BER of 10 ^ the 
IBMPDA performs only 0.6 dB from the SPA. With OSMLGD, the code is capable of correcting 
31 or fewer errors. A A 

VL Conclusion 

In this paper, we first presented a large class of arrays of circulant permutation matrices 
that are constructed based on cyclic subgroups of finite fields. Based on this class of arrays 
of circulant permutation matrices, we constructed a large class of new QC-LDPC codes whose 
Tanner graphs have girth of at least 6. Then, we analyzed the ranks of the parity-check matrices of 
codes constructed based on finite fields of characteristic 2 and derived combinatorial expressions 
for these ranks. Experimental results show that the codes constructed perform well over the 
binary-input AWGN channel with iterative decoding using the SPA and they outperform the 
corresponding pseudo-random QC-LDPC codes constructed with the PEG-algorithm. In the 
paper, we also identified a subclass of constructed QC-LDPC codes that have large minimum 
distances. Decoding of codes in this subclass with the SPA converges very fast. Furthermore, we 
showed that, when decoded with the binary message-passing decoding algorithm recently devised 
in [20], codes in this subclass give close to the SPA performance with enormous reduction in 
decoding complexity. These codes may find applications in communication or storage systems 
where good error performance, fast decoding convergence, simple decoders and low error-floors 
are required. We also showed that the class of RD-constrained matrices constructed in this 
paper contains the first class of RD-constrained matrices given in [7] and the third class of 
RD-constrained matrices given in [8] as special subclasses. 

The technique used to analyze the ranks of parity-check matrices of QC-LDPC code on cyclic 
subgroups of finite fields in this paper can be used to analyze the ranks of parity-check matrices 
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of QC-LDPC codes on additive subgroups of finite fields presented in [9]. 
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TABLE I 

Column and Row Weight Distributions of the Masking Matrix Z(63, 126) of Example 3 



Column Weight Distribution 


Row Weight Distribution 


Column weight 


No. of columns 


Row weight 


No. of rows 


2 


57 


8 


11 


3 


44 


9 


52 


8 


20 






30 


5 
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(225,147), BER, 50 Iterations SPA 
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->- ' (225,147), BLER, 10 Iterations SPA 
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Fig. 1. The error performance of the (225, 147) QC-LDPC code given in Example 1 over the AWGN channel. 
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E,/N^(dB) 

Fig. 2. The error performance of the (12096, 10587) QC-LDPC code given in Example 2 over the AWGN channel. 
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Fig. 3. The error performance of the (64386, 32193) QC-LDPC code given in Example 3 over the AWGN channel. 
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Sphere packing bound : 
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Fig. 4. The error performance of the (3969, 3645) QC-LDPC code given in Example 4 over the AWGN channel. 
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Fig. 5. The error performance of the (16129, 15437) QC-LDPC code given in Example 5 over the AWGN channel. 
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Fig. 6. The error performances of the (3969, 3243) QC-LDPC code given in Example 6 over the AWGN channel decoded 
with the IBMPDA and the SPA. 
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